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Tin-:  asskssm i;n  r  ui-  I'kkfokmanck  feedback  to 
INDIVIDUALS  IN  ORGANIZATIONAL  SETTINGS 

Recently  there  has  been  an  upsurge  of  interest  in  performance  feed¬ 
back  and  its  motivational  properties  in  organizational  settings.  This 
interest  has  developed  from  three  relatively  independent  sources.  The 
first  source  is  that  of  job  design  and  the  current  interest  in  what  is 
called  job  enrichment.  The  theoretical  underpinnings  of  this  view  are 
based  on  Mas low's  (1954)  higher-order  needs  as  espoused  by  Herzberg 
(Herzberg,  Mausner,  and  Snyderman,  1959;  Herzberg,  1966)  and  others.  Jobs 
are  assumed  to  possess  a  given  potential  for  arousing  and  meeting  higher 
order  needs  (Hackman  and  Oldham,  1975,  1976).  As  a  result,  jobs  can  be 
redesigned  or  "enriched"  to  meet  these  needs  of  job  incumbents  and 
therefore  reduce  their  alienation  from  work  (Ford,  1969;  Maher,  1971). 

Recently,  Hackman  and  Oldham  (1976)  have  provided  a  model  for  descri¬ 
bing  how  aspects  of  the  job  itself  influence  the  psychological  processes 
of  individuals  and.  in  turn, their  attitudes  and  behaviors.  This  model 
describes  three  classes  of  variables  essential  for  enriched  jobs.  One 
of  these  three  is  feedback.  Performance  feedback  is  seen  as  a  necessary 
condition  for  the  individual  to  obtain  knowledge  of  results  about  perfor¬ 
mance.  Presumedly  with  knowledge  of  results  about  performance  the  indi¬ 
vidual  can  experience  feelings  of  accomplishment  and/or  can  change  or 
redirect  his  or  her  behavior  in  order  to  perform  in  a  manner  that  will 
lead  to  feelings  of  accomplishment.  .  ' 

A  second  source  of  interest  in  feedback  is  that  of  expectancy  theory. 
Expectancy  theory  of  work  motivation  considers  each  employee  as  a  decision¬ 
maker.  This  view  of  motivation  concentrates  on  characteristics  of  the 
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work  environment  surrounding  an  individual's  performance  which  influence 
his  or  her  decision-making  abilities  (Porter  and  Lawler,  1968;  Mitchell, 
1974;  Vroom,  1964).  One  central  variable  in  this  theory  is  the  expectancy 
that  his  or  her  behavior  will  lead  to  a  given  level  of  performance.  In 
order  to  develop  an  expectancy,  the  individual  needs  to  receive  feedback 
about  his  or  her  performance.  Without  such  feedback,  it  is  not  possible 
for  the  individual  to  form  accurate  perceptions  of  the  expectancy  that 
behavior  will  lead  to  certain  levels  of  performance. 

Finally,  feedback  is  essential  to  role  theory  (Katz  and  Kahn,  1978; 
Oeser  and  O'Brien,  1967).  Work  behavior,  from  the  standpoint  of  roles, 
is  concerned  with  describing  those  behaviors  in  which  the  individual  will 
engage.  The  focus  is  not  so  much  upon  the  amount  of  effort  exerted  toward 
a  given  level  of  performance  as  it  is  on  the  direction  of  effort  —  e.g. , 
what  percent  of  the  time  does  a  sales  representative  go  through  orderbooks 
direct  the  behavior  of  clerks,  or  sell  to  customers?  From  this  standpoint 
feedback  guides  and  directs  the  appropriate  behaviors. 

Job  design,  expectancy  theory,  and  role  theory  have  all  three  had  a 
major  influence  in  recent  thought  about  the  behaviors  of  individuals  in 
organizations.  Furthermore,  all  three  positions  have  posited  a  central 
role  for  feedback  in  the  determination  and  influence  of  behavior.  However 
in  spite  of  the  importance  of  feedback  in  all  of  these  views,  performance 
feedback  in  organizations  is  little  understood  (Ilgen  et  al .  1977).  Part 
of  this  is  because  there  is  a  general  tendency  to  accept  leedback  as  "good 
or  "necessary"  without  critically  evaluating  the  nature  of  feedback. 

The  Ilgen  et_  al_  (1977)  review  was  a  critical  evaluation  of  the  feed¬ 
back  literature.  It  provided  a  description  of  several  dimensions  of 
feedback.  The  report  also  emphasized  the  often  overlooked  fact  that 


feedback  originates  from  some  source.  This  source  can  influence  consi¬ 
derably  the  nature  of  the  feedback  message  received  by  the  individual. 

The  extent  to  which  feedback  is  accepted  and  is  responded  to  by  the  indi¬ 
vidual  is  strongly  influenced  by  this  source.  Therefore,  any  adequate 
treatment  of  feedback  must  consider  the  source  from  which  it  is  received. 
Four  dimensions  of  feedback  were  identified.  In  addition,  two  dimensions 
dealing  with  the  way  in  which  sources  administered  feedback,  were  seen  as 
important.  The  four  primary  dimensions  of  feedback  were  its  sign ,  the 
timing  of  the  feedback,  its  specificity ,  and  the  frequency  with  which  it 
is  received.  The  fifth  and  sixth  dimensions  dealt  with  the  manner  in 
which  the  feedback  was  administered  by  a  source. 

In  any  setting  the  sources  of  possible  feedback  vary.  However,  in 
most  work  settings  there  exists  a  relatively  common  set  of  sources  which 
make  it  reasonable  to  consider  these  sources  across  a  wide  variety  of 
organizations  and  jobs.  The  sources  most  frequently  encountered  are:  the 
individual's  supervisor ,  co-workers ,  subordinates ,  and  the  job  itself.  In 
addition,  many  jobs  have  other  individuals  who  do  not  appear  in  the  normal 
chain-of-command.  For  example,  a  sales  representative  receives  feedback 
from  customers  even  though  these  customers  do  not  appear  .a  the  organiza¬ 
tion  per  se.  For  such  jobs,  these  other  individuals  are  extremely  im¬ 
portant.  Therefore,  it  is  necessary  to  consider  other  individuals  outside 
the  normal  chain-of-command. 

A  final  source,  and  perhaps  the  most  important  one,  is  the  individual 
himself  or  herself.  In  many  work  settings  the  individual  can  judge  per¬ 
formance  without  any  intervention  from  an  outside  source.  At  the  simplest 
level  the  individual  may  not  be  able  to  complete  the  task  and  it  is 
obvious.  For  example,  the  plumber  may  replace  the  faucet,  turn  on  the 
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water  to  the  faucet,  and  watch  the  water  continue  to  drip.  No  outside 
feedback  is  needed  in  such  a  case.  However,  it  does  illustrate  an  inter¬ 


esting  dilemma.  Is  the  dripping  faucet  feedback  from  the  self  (in  this 
case  feedback  the  plumber  gives  himself  or  herself)  or  is  it  feedback 
from  the  task  itself?  Most  would  say  it  is  feedback  from  the  task.  How¬ 
ever,  the  individual  must  recognize  what  the  task  cues  (dripping  faucet) 
mean  and  this  in  a  sense  is  the  feedback.  Therefore,  the  most  direct 
agent  in  the  process  is  the  individual. 

As  we  attempted  to  write  clear  and  concise  items  for  the  instrument, 
the  distinction  between  self  and  task  was  extremely  perplexing.  In  fact 
pilot  work  showed  that  we  could  not  keep  them  apart.  As  can  be  seen  later, 
the  end  result  was  a  combination  of  self  and  task  with  items  similar  to 
the  following:  "On  a  job  like  mine  I  can  tell  when  I  have  done  a  good 
job." 

The  purpose  of  the  present  research  was  to  develop  an  instrument  to 
measure  the  dimensions  of  feedback  and  the  sources  from  which  the  feedback 
was  obtained.  An  instrument  was  developed  to  be  administered  to  employees 
and  supervisors  in  order  to  assess  the  feedback  environment  of  the  em¬ 
ployees.  This  report  describes  the  research  designed  to  assess  the 
psychometric  properties  of  such  an  instrument. 


METHOD 


Item  Development 

The  items  for  the  instrument  were  generated  and  pretested  in  three 
phases.  The  first  phase  involved  the  creation  of  items  by  the  investiga¬ 
tors  to  fit  the  categories  identified  by  the  review.  Those  items  which 
could  be  reliably  sorted  into  categories  were  maintained  for  the  preliminary 
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feedback  Instrument.  This  instrument  was  then  administered  to  two  samples. 
The  first  consisted  of  approximately  150  students  at  Purdue  University  who 
were  asked  to  complete  the  questionnaire  with  reference  to  a  summer  job. 

All  participants  selected  had  held  a  summer  job  the  summer  immediately 
preceding  administration  of  the  questionnaire.  These  participants  were 
paid  for  their  participation  and  responded  to  the  items  with  reference  to 
their  summer  jobs.  They  also  provided  information  about  the  clarity  of 
the  items  and  the  instructions. 

A  second  sample  consisted  of  36  supervisors  in  a  large  automobile 
manufacturing  plant.  These  supervisors  completed  the  questionnaires  on 
company  time  and  mailed  their  responses  to  the  investigators. 

Analyses  of  these  data  were  conducted  for  two  purposes.  First,  items 
or  instructions  which  were  unclear  were  revised  or  eliminated.  Second, 
correlations  among  items  were  calculated  in  order  to  select  groups  of 
items  that  clustered  into  the  categories  defined.  On  the  basis  of  these 
preliminary  analyses,  the  final  feedback  questionnaire  was  assembled.  This 
questionnaire  appears  as  an  appendix  to  this  report. 

Samples 

Two  samples  were  used  for  the  main  body  of  the  research.  The  first 
consisted  of  employees  of  a  large  manufacturing  plant  in  the  midwest.  Par¬ 
ticipants  were  selected  randomly  with  two  restrictions.  First,  each  parti¬ 
cipant  was  required  to  have  worked  with  his  or  her  supervisor  long  enough 
to  have  received  at  least  one  formal  appraisal  from  the  supervisor.  The 
second  restriction  was  that  two  employees  from  each  selected  work  group 
were  included  in  the  sample.  (The  reasons  for  the  latter  restriction  are 
outlined  in  Technical  Report  No.  3,  1978.)  In  total  104  employees  were 
identified  for  the  sample.  Of  these  100  actually  completed  the 


questionnaires.  In  addition,  the  52  supervisors  of  these  L04  employees 
were  asked  to  provide  several  sets  of  data.  Fifty  returned  questionnaires 

The  second  sample  consisted  of  42  employees  iron  the  administrative 
offices  of  a  large  midwestern  university.  These  employees  were  primarilv 
from  the  clerical  staff  but  also  Included  a  number  of  administrative 
personnel. 

Procedure 

Sample  1:  Once  selected  for  participation  in  the  study,  employees 
were  sent  a  letter  from  the  researchers  at  Purdue  describing  the  nature 
of  the  questionnaire  to  be  completed  and  asking  for  their  participation. 
Those  employees  who  agreed  to  participate  were  scheduled  to  report  to  a 
large  auditorium  in  one  of  the  nine  plant  locations  within  the  city. 
Employees  were  given  a  time  to  report  to  this  location  and  no  one  refused 
to  participate  in  the  research. 

At  the  scheduled  time,  employees  reported  to  a  large  auditorium, 
were  instructed  on  the  nature  of  the  research,  and  were  allowed  to  fill 
out  the  questionnaire.  The  researchers  remained  in  the  room  and  answered 
questions  as  they  arose.  Upon  completion  of  the  questionnaire  the  parti¬ 
cipants  signed  a  statement  giving  permission  to  use  their  data  for 
research  purposes  and  were  dismissed. 

Sample  2:  Letters  were  sent  to  approximately  200  employees  working 
in  administrative  positions  at  the  university.  These  letters  described 
the  nature  of  the  questionnaire  and  asked  participants  to  volunteer  to 
fill  out  the  questionnaire  on  two  occasions  one  month  apart.  Participants 
were  informed  of  the  dates  of  their  participation  and  were  told  they 
would  be  paid  ten  dollars  for  their  participation.  The  one  restriction 


was  that  the  employee  should  have  been  in  the  present  position  long 
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enough  to  have  received  a  supervisory  evaluation  on  at  least  one  occa¬ 
sion. 

Responses  to  these  questionnaires  resulted  in  42  participants  who 
reported  to  the  assigned  location  at  the  prescribed  time.  At  that  time 
the  researchers  again  described  the  study  and  distributed  the  question¬ 
naires  . 

Approximately  one  hour  was  needed  to  complete  these.  When  the 
questionnaires  were  completed  participants  returned  them  and  signed  a 
statement  allowing  the  use  of  the  data  for  research.  The  second  session 
repeated  the  procedures  of  the  first  and  occurred  one  month  later.  The 
participants  tilled  out  exactly  the  came  ques  t  I  oiiua  I  l  e  at  that  time. 

When  they  had  completed  it,  they  turned  in  the  questionnaire  and  received 
their  payment  of  ten  dollars. 

Dimensions  of  the  Feedback  Instrument 

Table  1  lists  the  dimensions  of  feedback  and  the  nature  of  the  items 
used  to  measure  them.  Two  things  should  be  noted  specifically  from  that 
table.  First, note  that  each  of  the  dimensions  on  the  far  left  is  measured 
for  both  positive  and  negative  feedback.  Column  two  indicates  this. 
Second, note  that  with  two  exceptions  each  dimension  is  also  paired  with 
every  source.  The  two  exceptions  are  the  dimensions  dealing  with  manner 
and  with  public  versus  private  information.  For  the  latter  two  only 
interpersonal  sources  were  included. 

From  Table  1  it  is  obvious  that  the  sign  and  the  source  is  always 
paired  with  a  particular  dimension.  This  is  because  the  dimension  itself 
cannot  be  considered  without  considering  the  sign  of  the  feedback  or  the 
source  from  which  it  was  received.  Therefore,  it  was  necessary  to  write 
items  that  include  three  elements  in  each  of  the  items.  Finally,  the 
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last  colter.  of  Table  1 
the  dimension  as  listed 
item  numbers  listed  on 


identifies  the  i terns  that  vere  included  to  co-prise 
.  The  item  numbers  in  the  last  column  refer  to  the 
the  questionnaire  which  appears  in  the  appendix. 
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Table  1 


Dimensions  of  Feedback.  Measured  with 
the  Feedback  Questionnaires  as  well  as 
a  Listing  of  the  Items  Comprising  F.ach  Dimension 


Dimension 

Source 

Sign 

Item  Numbers 

Timing 

Supervisor 

Positive 

1, 

n, 

21 

11 

It 

Negative 

0 

> 

16, 

26 

•  1 

Co-workers 

Positive 

3, 

3  2, 

22 

II 

II 

Negative 

4, 

17, 

27 

II 

Subordinates 

Positive 

5, 

13, 

23 

II 

II 

Negative 

6, 

18, 

28 

H 

Others 

Positive 

7, 

14, 

24 

II 

II 

Nega t ! ve 

8. 

19, 

29 

11 

Self 

Pos i t ive 

9, 

15, 

25 

»» 

II 

Meg.l  I  ( Vi' 

>0, 

?0. 

30 

Specificity 

Supervisor 

Posi tive 

31, 

41, 

51 

II 

II 

Negative 

32, 

46, 

56 

11 

Co-workers 

Positive 

33, 

42, 

52 

II 

II 

Negative 

34, 

47, 

57 

II 

Subordinates 

Positive 

35, 

43, 

53 

II 

II 

Negative 

36, 

48, 

58 

II 

Others 

Positive 

37, 

44, 

54 

11 

II 

Negative 

38, 

49, 

59 

It 

Self 

Positive 

39, 

45  > 

55 

II 

II 

Negative 

40, 

50, 

60 

Frequency 

Supervisor 

Positive 

61, 

71, 

81 

»• 

II 

Negative 

66, 

76, 

86 

•  1 

Co-workers 

Positive 

62, 

72, 

82 

II 

II 

Negative 

67, 

77, 

87 

♦1 

Subordinates 

Positive 

63, 

73, 

83 

II 

11 

Negative 

68, 

78, 

88 

II 

Others 

Positive 

64, 

74, 

84 

II 

II 

Negative 

69, 

79, 

89 

If 

Self 

Pos i tive 

65, 

75, 

85 

II 

II 

Negative 

70, 

80, 

90 

Table  1  Continued 


Dimension 

Source 

Sifin 

Item  Numbers3 

Manner 

Supervisor 

Positive 

91,  99,  107 

II 

II 

Negative 

92,  103 

II 

Co-workers 

Positive 

93,  100,  108 

II 

II 

Negative 

94,  104 

II 

Subordinates 

Positive 

95,  101,  109 

It 

II 

Negative 

96,  105 

II 

Others 

Positive 

97,  102,  110 

It 

II 

Negative 

98,  106 

Public  vs. 

Private 

Superv isor 

Posi tive 

111,  119,  127 

II 

II 

1  1  Vi- 

ii.*.  i  ?  i ,  m 

i« 

Cci-woi  krrs 

Pus  1  l  1  vi- 

1 1  1,  120,  128 

II 

ii 

Negative 

114,  124,  132 

II 

Subordinates 

Positive 

115,  121,  129 

II 

it 

Negative 

116,  125,  133 

II 

Others 

Positive 

117,  122,  130 

II 

n 

Ne gative 

118,  126,  134 

Three  sets  of  analyses  were  used  to  evaluate  the  quality  of  the 
feedback  instrument.  The  first  set  addressed  the  internal  consistency 
reliabilities  of  the  subscales  described  in  Table  1  and  also  combinations 
of  subscales  created  by  collapsing  subscales  over  sign,  over  sources, 
and  over  both  sign  and  sources.  Internal  consistency  was  assessed  with 
Cronbach's  coefficient  alpha. 

One  issue  did  arise  when  calculating  coefficient  alpha.  All  items 
Included  a  r.ot  «>f  numerical  scales  and  also  a  category  labeled  "does  not 
apply"  which  allowed  the  rater  to  omit  cases  that  were  not  applicable. 

This  category  was  coded  zero  and  included  in  the  calculation  of  internal 
consistency  for  it  was  felt  that  if  the  dimension  actually  did  not 
apply,  the  respondent  should  choose  "does  not  apply"  on  all  items.  The 
degree  of  agreement  for  this  case  was  just  as  important  as  agreement  on 
other  scale  values.  Therefore,  "does  not  apply"  was  coded  zero  and 
included  in  the  calculation  of  coefficient  alpha.  However,  this  proce¬ 
dure  created  one  problem.  This  arose  when  large  numbers  of  participants 
existed  for  which  the  dimension  did  not  apply.  For  example,  nearly  half 
of  the  sample  had  no  subordinates.  These  participants  so  dominated  the 
variance  in  response  to  dimensions  dealing  with  subordinates  that  the 
coefficient  alpha  was  artificially  high.  Therefore,  coefficient  alpha  was 
also  calculated  with  and  without  the  individuals  who  chose  "does  not 
apply"  for  all  items  in  the  subscale. 

A  second  estimate  of  reliability  was  the  correlation  between  re¬ 
sponses  at  time  one  and  time  two  for  the  administrative  staff  sample.  In 


this  case  test-retest  reliabilities  were  reported  with  the  time  interval 
equal  to  one  month. 

Finally,  an  interrater  reliability  estimate  was  assessed  for  the 
primary  dimensions  listed  in  Table  1  by  correlating  supervisor  descriptions 
of  the  feedback  received  by  the  chosen  focal  person  with  the  focal's 
responses.  Exactly  the  same  items  were  used  for  both  raters  except  for 
the  fact  that  the  target  person  was  the  self  for  focals  and  the  focal 
subordinate  for  superiors. 

Tables  2  through  6  report  coefficient  alphas,  test-retest  reliabilities 
and  interrater  reliabilities  for  the  feedback  dimensions  assessed  using 
three  subsamples.  Internal  consistency  statistics  are  based  upon  the 
sample  of  siihonl  I  nat  <*ii  of  which  approximately  100  persons  were  available. 
Test-retest  reliabilities  were  based  upon  the  42  employees  from  the 
administrative  departments  at  Purdue  University,  and  the  interrater 
correlations  were  obtained  from  forty  pairs  of  supervisors  and  subordi¬ 
nates  in  the  manufacturing  sample  for  which  the  supervisor  described  the 
feedback  of  a  particular  focal  subordinate.  The  data  and  conclusions  from 
them  are  described  in  the  discussion  section  that  follows. 
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DISCUSSION 


The  discussion  that  follows  will  evaluate  each  of  the  feedback  dimen¬ 
sions  presented  in  tables  two  through  six.  However,  before  treating  each 
individually,  one  generalization  stands  out.  It  is  clear  from  the  tables  that 
supervisors  and  subordinates  simply  do  not  agree  on  the  nature  of  the  feed¬ 
back  received  by  the  subordinate. 

This  disagreement  is  consistent  with  previous  research.  For  example, 
Hackman  and  Lawler  (1971)  found  no  correlation  between  supervisor  and  sub¬ 
ordinate  descriptions  of  the  amount  of  feedback  available  in  the  subordinate's 
job.  Nevertheless,  the  lack  of  agreement  found  in  our  research  is  somewhat 
more  disconcerting.  Feedback  was  assessed  by  a  variety  of  items  tapping 
several  dimensions  rather  than  a  single  item  dealing  with  a  global  aspect  of 
feedback.  We  reasoned  that  if  the  dimensions  of  feedback  were  spelled  out 
explicitly,  agreement  would  be  more  likely.  In  addition,  although  disagree¬ 
ment  may  exist  on  global  descriptions,  specific  descriptions  would  allow 
for  the  discovery  of  those  dimensions  on  which  agreement  did  exist  as  well 
as  those  on  which  it  did  not.  Only  in  one  case  was  substantial  agreement 
found.  This  was  with  regard  to  the  manner  in  which  positive  feedback  was 
given  by  subordinates  (r  =  .64,  p  .01).  However,  given  the  large  number 
of  insignificant  correlations,  little  confidence  can  be  placed  in  this 
finding.  It  is  most  parsimonious  to  conclude  that  supervisors  and  subordi¬ 
nates  do  not  agree  on  the  nature  of  feedback  received  by  subordinates. 

The  lack  of  covariation  between  the  two  is  best  attributed  to  different 
perspectives  due  to  differences  in  roles,  boreman  (1975)  made  the  same 
point  with  regard  to  performance  appraisals.  He  pointed  out  that  low  con¬ 
vergent  validity  among  peers,  superiors  and  subordin^  es  'd  not  necessarily 


reflect  the  fact  that  the  ratings  of  one  or  more  of  the  sets  were  invalid. 

It  only  implied  that  each  group  dealt  with  different  aspects  of  the 
incumbent's  performance.  As  a  result,  valid  ratings  on  all  dimensions 
probably  were  not  possible  across  the  diverse  sets  of  groups. 

With  regard  to  our  feedback  measure,  such  an  interpretation  would 
argue  that  supervisors  may  not  be  able  to  judge  feedback  from  sources  other 
than  themselves.  Their  ratings  on  these  other  dimensions  should  not  agree 
with  incumbents.  Nevertheless,  we  would  expect  some  convergence  on  descrip¬ 
tions  of  supervisory  feedback.  Of  the  ten  correlations  dealing  with 
supervisor  feedback  significant  correlations  were  found  on  two.  Although 
the  ratio  of  significant  correlations  for  supervisors  (2  of  10  or  .20)  is 
greater  than  for  all  others  (2  of  40  or  .05),  it  is  hardly  impressive. 

The  disagreement  between  supervisors  and  incumbents,  while  not 
unexpected,  is  perplexing  from  the  standpoint  of  prescri''1'  ve  recommenda¬ 
tions  for  improving  feedback.  Changes  in  feedback  must  be  made  by  agents 
external  to  the  job  incumbent  in  most  cases.  These  changes  are  accomplished 
either  by  altering  task  designs  or  by  altering  the  practices  of  supervisors, 
subordinates,  co-workers,  or  others.  Unfortunately,  without  a  reference  of 
whose  descriptions  were  more  correct,  as  is  the  case  with  field  research  such 
as  this  study,  we  are  unsure  about  what  to  change.  This  uncertainty  points 
out  the  need  to  conduct  further  research  in  settings  where  the  objective 
nature  of  the  feedback  is  known.  In  such  settings  supervisor  and  subordi¬ 
nate  descriptions  must  be  obtained  in  order  to  compare  them  to  the  standard 
known  feedback  as  well  as  to  each  other. 

Turning  our  attention  from  the  interrater  to  the  intrarater  data  in 
Tables  2  through  6,  several  generalizations  can  be  made.  First  of  all,  the 
quality  of  all  five  feedback  dimensions  (timing,  specificity,  frequency, 
manner,  and  public  versus  private)  is  extremely  good  when  all  feedback  is 


>') 

considered.  The  internal  consistency  reliabilities  are  around  .80  or 
above  and  the  test-retest  correlations,  with  the  exception  of  the  timing  01 
feedback  are  quite  high  considering  the  length  of  the  time  period  between 
questionnaire  administration  (one  month). 

The  same  general  pattern  held  for  feedback  dimensions  when  considered 
within  sign.  That  is,  when  positive  feedback  was  separated  from  negative. 
However,  the  magnitude  of  the  internal  consistency  correlations  dropped  to 
the  mid  to  lower  .70's.  This  drop  reflects  the  fact  that  the  number  of 
items  was  reduced  to  one-half  the  number  used  in  the  overall  measure. 
Furthermore,  correlations  over  time  dropped  for  all  but  the  manner  in  which 
negative  feedback  was  given.  Further  discussion  of  the  results  needs  to 
focus  upon  each  individual  scale.  The  discussion  that  follows  treats  each 
scale  separately. 

Timing.  Only  the  timing  of  feedback  from  supervisors  tended  to  show 
good  psychometric  properties  for  both  positive  and  negative  feedback  as 
well  as  the  combination  based  upon  responses  collapsed  over  sign.  In  all 
cases,  the  coefficient  alphas  were  in  the  high  seventies  or  eighties  and 
over  one  month  the  test-retest  correlations  were  in  the  mid  .60' s.  There¬ 
fore,  it  seemed  reasonable  to  conclude  that  the  scale  does  a  reasonable 
job  of  measuring  the  timing  of  feedback  from  supervisors. 

With  regard  to  sources  other  than  supervisors,  the  conclusions  were 
less  strong.  The  measure  of  timing  from  co-workers  showed  low  internal 
consistency  and  did  not  hold  up  over  time  for  positive  feedback  (r  =  .18, 
p  =  n.s.).  This  low  correlation  is  perplexing  because  many  alternative 
explanations  tend  to  be  eliminated  on  logical  grounds.  One  might  expect 
that  using  a  stimulus  like  co-workers  which  is  composed  of  more  than  one 
individual  might  lead  to  unreliable  ratings  if  the  rater  used  different 


persons  as  a  reference  at  each  time.  For  example,  co-worker  X  might  have 
been  salient  the  first  time  whereas  co-worker  Y  was  used  as  the  person  the 
second  time.  However,  if  this  were  the  case,  one  would  expect  negative 
feedback  from  co-workers  not  to  demonstrate  convergence  over  time  and  also 
other  multi-person  groups  such  as  subordinates  and  others  should  have  dis¬ 
played  drop.  They  did  not.  Furthermore,  the  stem  of  the  items  comprising 
these  other  items  and  those  for  supervisors  were  the  same  as  they  were  for 
co-workers  with  the  exception  of  the  name  of  the  source  who  provided  the 
feedback.  If  the  items  were  confusing,  again  all  other  sources  should  have 
had  low  test-retest  correlations.  Such  was  not  the  case. 

Measures  of  the  timing  of  feedback  from  the  remainder  of  the  sources 
<>t  ho  r  than  ‘self  displayed  nmderalo  lest  -reiest  eurrelat  Ions  hut  poor  Inloinal 
consistency  ones.  In  all  cases  the  large  number  of  responses  of  "not 
applicable"  meant  that  these  cases  should  be  excluded  from  calculations  of 
coefficient  alpha.  With  regard  to  the  self  as  a  source  it  was  not  necessary 
to  exclude  any  individuals,  but  neither  was  the  reliability  acceptable  when 
sign  was  kept  distinct. 

When  positive  and  negative  feedback  were  combined ,  the  result  was  more 
positive.  Under  this  condition,  the  measure  did  well  for  supervisors,  poorly 
for  co-workers  when  test-retest  was  considered  but  well  when  internal  con¬ 
sistency  was  used,  and  moderately  well  for  all  other  sources  on  both  cri¬ 
teria.  Thus, it  was  concluded  that  the  scale  measured  timing  reasonably 
well  if  one  were  not  interested  in  distinguishing  between  positive  and 
negative  feedback  and  if  one  were  to  proceed  with  caution,  if  interested  in 
the  timing  of  feedback  from  co-workers. 

Specificity.  The  pattern  of  the  specificity  measures  is  quite  similar 
to  that  of  timing.  Measures  based  upon  combinations  of  items  across  sign  or 


across  sources  of  feedback  possess  moderately  good  internal  consistency  and 
moderate  stability  over  time.  The  exception  to  the  latter  again  is  the 
specificity  of  feedback  from  co-workers  witli  the  lower  correlation  occurring 
with  negative  rather  than  positive  feedback. 

If,  however,  measures  are  desired  which  separate  the  feedback  on  the 
basis  of  sign,  fewer  subscales  appeared  to  be  acceptable.  In  this  case  all 
feedback  from  supervisors  and  subordinates,  and  positive  feedback  from  co¬ 
workers  appeared  reasonable.  On  the  other  hand,  measures  of  the  specificity 
of  feedback  from  others  were  moderate  to  low  and  those  for  self  were  totally 
unacceptable. 

The  failure  of  self  measures  to  show  any  consistency  either  within 
sets  or  over  time  may  mean  that  a  construct  of  specific  feedback  to  oneself 
may  have  little  meaning.  Perhaps  one  never  considers  self  feedback  in 
specificity  terms.  One  either  does  or  does  not  give  oneself  feedback  but 
if  it  is  given  it  is  by  nature  specific.  Obviously  our  data  cannot  speak 
to  the  issue  of  why.  Nevertheless,  they  do  question  the  extent  to  which 
specific  self  feedback  is  a  reasonable  construct.  The  issue  deserves  furthe 
research. 

Frequency.  The  quality  of  the  measures  of  frequency  was  considerably 
more  mixed  than  the  other  two  sets  of  measures.  While  measures  of  the 
frequency  of  feedback  from  superiors  tended  to  be  quite  good  as  well  as  the 
frequency  of  positive  feedback,  the  other  measures  varied  in  quality.  In 
fact,  this  was  also  true  to  some  extent  for  feedback  from  supervisors. 
Ratings  of  negative  feedback  from  supervisors  possessed  moderate  test-retest 
reliability  (r  =  .69)  but  internal  consistency  was  unacceptable  (r  _S  .70). 

Considering  each  source  in  turn  we  find  that  positive  and  negative 
feedback  from  co-workers  were  moderately  well  measured  both  from  the 


standpoint  of  internal  consistency  and  stability  but  when  the  two  were 
combined  it  was  not  stable.  The  frequency  of  feedback  from  subordinates 
was  only  moderately  internally  consistent  and  stable  when  the  feedback 
measure  was  for  negative  feedback.  The  frequency  from  others  lacked  both 
internal  consistency  and  stability  over  time.  Finally,  feedback  to  oneself 
lacked  acceptable  internal  consistency  but  showed  quite  good  stability  over 
time.  Therefore,  with  the  exception  of  overall,  positive,  and  negative 
feedback  scores,  the  quality  of  the  instrument  for  measuring  the  frequency 
of  feedback  varied  across  and  within  sources. 

Manner  of  Giving  Feedback.  Measures  of  the  manner  in  which  feedback 
was  given  all  met  criteria  for  good  psychometric  qualities  reasonably  well. 
Interestingly,  feedback  from  supervisors,  which,  for  the  other  sets  of 
items,  tended  to  be  better  measured  than  feedback  from  other  sources,  had 
the  lowest  test-retest  correlations  (rtt  for  positive  feedback  from  super¬ 
visors  *  .42  and  for  all  feedback  from  supervisors  *  .47).  However,  the 
internal  consistency  coefficients  were  acceptable  (r  =  .80  and  .88  when 
not  applicable  items  were  included).  Therefore,  it  was  concluded  that  the 
manner  in  which  feedback  was  given  was  well  measured. 

Public  versus  Private.  Measures  of  the  degree  to  which  feedback  was 
public  or  private  were  acceptable  when  subscales  were  combined  to  form 
measures  of  positive,  negative,  and  overall  feedback.  Beyond  that  point, 
all  other  scales  either  lacked  acceptable  internal  consistency  and/or  sta¬ 
bility.  Therefore,  it  was  best  to  conclude  that  only  at  the  more  global 
levels  did  the  measures  hold  up.  This  is  unfortunate  because  changes  in 
the  public  or  private  nature  of  the  feedback  must  be  made  at  the  more 
specific  levels  than  at  the  global  ones. 


CONCLUSIONS 


To  a  large  extent  the  Instrument  was  able  to  measure  satisfactorily 
the  dimensions  of  feedback  identified  by  the  llgen  e_t  jil  (1977)  review. 

The  instrument  was  particularly  successful  when  dimensions  of  feedback 
were  measured  without  differentiating  according  to  both  sign  and  source, 
and  criteria  of  internal  consistency  were  used  for  evaluation.  In  addition, 
for  four  of  the  five  dimensions  (timing,  specificity,  frequency,  and 
manner)  one  or  more  of  the  source  by  sign  dimensions  also  provided  an  accep¬ 
table  measure.  This  was  particularly  true  when  the  supervisor  was  the 
source  of  feedback.  The  only  feedback  not  adequately  measured  for  most  sub¬ 
scales  was  that  of  the  public  versus  private  nature  of  the  feedback. 

When  the  quality  of  the  instrument  was  evaluated  in  terms  of  the  con¬ 
vergence  between  supervisor  and  subordinate  descriptions  of  feedback,  no 
convergence  existed.  This  lack  of  convergence  is  understandable  but 
disturbing.  It  is  our  belief  that  no  measure  is  going  to  find  agreement 
between  supervisors  and  subordinates  on  the  subordinate's  feedback  in  most 
organizational  settings.  This  fact  does  not  seem  to  reflect  upon  the  nature 
of  our  instruments,  but  rather  it  describes  the  nature  of  the  perceptual 
discrepancies  between  supervisors  and  their  subordinates  with  regard  to 
feedback.  It  seems  clear  to  us  that  incumbents  in  these  two  roles  have 
vastly  different  perspectives  and  views  of  the  feedback  environment  of  the 
subordinate.  As  a  result,  the  lack  of  correlation  between  supervisor  and 
subordinate  descriptions  that  we  observed  simply  reflects  the  extent  of  the 
disagreement. 

In  spite  of  this  disagreement,  we  do  not  mean  to  imply  that  what  is 
is  what  should  be.  If  changes  for  improvements  in  subordinate  feedback  are 


to  be  made  by  superiors  some  consensus  must  exist  between  these  two 
groups.  Our  Instrument  only  documented  the  existing  differences.  Future 
research  should  work  to  obtain  convergence  in  the  perceptions.  The 
existence  of  an  instrument  such  as  the  one  described  here  which  possesses 
reasonable  psychometric  properties  on  several  of  the  dimensions  deemed 
relevant  for  feedback,  provides  a  starting  place  for  constructing  and 
measuring  feedback  environments,  and  then  working  to  eliminate  some  of 
the  areas  of  disagreement  between  supervisors  and  their  subordinates. 


Correlations  between  Supervisor  and  Focal  Subordinate 
Description  of  Feedback  Dimensions 
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